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MATRIX ANALYSIS: A PRAGMAlic 
APPROACH TO CURRICULUM DESIGN 



Intlroduction: 



Inloecember, 1971, the Appalachia Educational Laboratory (AEL) was awatded 
a blanning grant to explore the possibility of establishing an Experience 
Bdsed Career Education program in Kanawha County, West Virginia. In May, 
lp72, a coptract^was signed with the U.S, O^^fice of education for the- de- 
velopment of an operational hBCE program, AEL's program had to meet the 
efinition of Model II Career Education and its characteristics ^had to in- 

fclude: ' . . * 

• The locus of student activity carried out in the community. 



Career Exploration and Career Decision-making had to result 
from first-hand involvement, by the student with careers. 



. ' • Integration of academic studies with community experiences 

was to be offered to each student to the maximum extent 
possible. , , 

• Each student v^s to receive an Individualized Program of 
study to ensure the widest possible range.of career explor- 
. ■ ation aod cardbr choice. Students were not to be tracked or 

channeled into careers or programs of study, because of race, ^ 
sex, or spcio-economic factors. \ 

Given the mandate outlined above, the thrust^of the EBCE design problem 

was to take the last two years of secondary edycation, alon-g with the 

concepts of the World of'Work,, and develop an educational schema that 

would provide a systematic , and coordinated experiential learning program 

for each student. To compound the magnitude of the problem, the design 

efforts had to obtain and coordinate programmatic inputs from diverse 

> - community groups, business and Idbor groups, educators at the state and 

local levels, and the Kanawha County Scl^ool Board. A detailed description 

o'f the design procedures employed in the development of the 'AEL/HBCE pro- || 

gram is not possible within the scope and intent of this paper. However 

• thy processes whereby the multiple design and development tasks were accomp- 

lished are completely described in the discussions that follow, 
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Design^Strategies : 

The basic design strategy used to develop^ the 
AEL/EBCE program involved a five phase, twelve 
step approach to curriculum design. The ma;}or 
advantage of the strategy employed by the 
EBCE Design Staff is that it enables the cur- 



SYSTEM DESIGNI PHASES 

Devatopment 



Design. 




riculum planners to: (1) develop a comprehen- conceptualization 

I 

sive initial plan of the pf^^ram's overall 
characteristics and configuration; (2) organize - . Figure 1 

;^he resources and multiple expert inputs required to achieve the desired 
program configuration; and (3) systematically identify and address the oper- 
ational requirements and constraints of the planned program. The five\design 
phases of Conceptualization, Design, Development, Production, and Implcmeftta- 
tion are all too often looked upon as a series of discrete tasks. However, 
when these tasks are undertaken sequcn'tialiy , the likely outcome is a prq-v 

^ gram that '4ooks good on paper" but falls flat in the realities of the oper- 

i 

ational setting. Figure 1 displays the relationships (of the five dcsig^ 
pha3es) that were employed for the curriculum' design of the AEL/EBCE program. 



tmptementatton 



While the phases were accomplished in a linear fashion, the requirements 



of 



the later phases (4^nd 5) were addressed in the early phases (1 and 2)f of 
the curriculum design effort. The following is a brief summary of the Jfiyer 



1 desi 



ign ^h 



ases : 



Conceptualization: during this phase the basic program goals,/ objec- 
tives, and configuration of the program arc defined. It is ci^itical ^ 
that the operational requirements and constraints be anticipated and 
addressed during this phase. 

Design: during this phase the basic. conceptualization is expanded 
and the pTOG^vim documents, materials, resources, and procedures are , 
identified and their general formats are outlined "The costs and the 
resources required to produce the planned system materials must be 
considered during ther design phase to ensure that all materials can 
in fact be produced. 

2, 



Development: during this phas6 ,the system materials are written or 
procurred in accordance with the requirements established in both 
the Conceptualisation and Design Phases. Student learning materials 
are* to be tried out and validated oh a representative sample 

" • Production: during this phase the neceissary art work and me<Jia work 
are completed to produce thq camera-i?eady copy of all system documents, 
materials, and manuals. All other resources, including the learning 
environment, are organized so as to support the operational require- • 
' ments of the program. 

• Implementation: ' during this phas§ all program materials are opera- 
tionally organized and Staff Training is conducted to qualify the 
instructional staff on all phases of program operation. 

The design phases described above provides the conceptual framework whicji 

g " , -if." 

defines what must be done in order to create an operationally sound program 

of learning* <^ . • ' 

-a 

SYSTEM DESIGN PROCESS 



Design Process: 

A detailed display of the twelAte design steps 
is provided in Appendix A of -this paper .* The 
intent here is to develop a gcheral descrip- 
tion of the design steps and to show the re- 
lationship of these steps to the five design 
phases described; in the preceding sectiion. 
The twelve design steps are listed accross 
the top of Figure 2. The systematic appli- 
cation of these steps produce: 
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A complete listing of program content. 
A complete* listing of the instructional resources required 
to support student learning of the progranj content. 
A diSip^lay of potential student learning activities. 
A listing of student-centered learning objectives. ' 
An organizational plan for the learning environment or 
educational facilities. 

A complete set of teacher-ccHtered and student-centered 
instructional materials. 

An operationally sound management system for the documenta- 
tion and coordination of student progress and performance. 



Figure 2 
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The twelve'design steps, in suronary.- produce all of -he program materials 
required to: (1) esta|)lish WHAT the program will cover and WHAT instructional 
resources are required to support student leirning; (2) define WHERE student 
learning will occur and the conditions underwhich it will pccur; W.(3) 
establish procedureys to HOW^ach student's program will be delivered 
and managed. (Nichols. SchiU.^nd McCartin. pp.B24-29.^ 1971) .. The intent 
of. Figure 2 is to show .that in the Conceptual izat ion Phase selected design 
steps are used to establish .the initial definitions of WHAT the program 
will cover. WHERE the le'arning will occur, and HOW the program will be managed 
In the Design Phase additional steps are employed to expand and refine the 
initial definitions into 'detailed descriptions of all program .docuiSents . 
materials, resources, and procedures. During the actual Development Phase 
the results of the first two phases are used to write and validate the re- 
quired tetcher-centpred ani student-centered materials. The Production . 
Phdse utilizes' the steps that result in the final format and reproduction.^ 
of -'all program materials. In the" Implementation Phase steps are applied to 
operationally orgartized the program materials and to provide the training 
reqiiired to successfully install the program. 



The system design process employed in the development of the m/EBCE pro- 
gram requires that the "What'" the "IVhere." and' the "How" of program opera- 
tion be identified and systematically defined in each of the initial phases 
';of the design proces% -(i .e. , Conceptualization, Design, and Development). 
The design process further requires that in each phase the overall program 
requirements be continually addressed' and that the information produced.in 
a -given design phase is used as the. data base for the efforts in the sub- 
sequent phase of design activity. The .strategies encompassed by this design 
process "provides "the framework within which complex sets of program infor- 
mation and resources can be gathered, organized, and developed into a sys- 



* 
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•tematic and operationally sound program of learning. The section that fol- 
lows describes the application of this design ^process to the development of a 
the AEL/EBCE program, ' . . 

EBCE Design Factors; " * " - ' . \ 



/ - 



In April, 1974, a formal review of the AEL/EBCE program was conducted by^^ ' 

select committee established by the National Institute of Education. This 

select committee consisted of the following members: 

<Dr. Keith ^oldhamjier. Chairman Mr . TlaudB~-Bro\^h 

Dean, College of Education . Director of Research 

Michigan State University and Education . 

Teamsters Local Union 688 
Dr. Glenys G. Unruh St. Louis, Missouri ^ 

Assistant Superintendent for 
• Curriculum and Instructiofi" Mr. Charles R. Bowen 

University City School System Program Director, Educational 

Univei'sity City, Missouri Development Corporate Staff 

International Business Machines 



Dr, Richard A. Graham * New York, New York 

Federal Executive Fellow 
The' Brookings Institutions 



After a comprehensive and critical review of the AEL program the select com- 
mittee's report, currently available from the National Institute of Education, 
listed the program's overall strengths and weaknesses. Their review of the 

Instructional System produced the following observation: 

ft 

The (AEL/EBCE) instructional system flows from a design which 
is virtually unlimited in its potentia^l power for delivering 
{ instructional ob^OGtives. Although complex, its interrejation- 
ships are organized with a rationality that provides for ease 
< in utilization. Working from a scries of matrices, the designers 

have created a system that can continually generate new curricular 
' and instructional concepts and objectives in response to changing 
knowledge and environment. The instructional system appears to 
have the quality of ready transportability to replication sites. 

The back drop fof/'thc instructional system includes five p^tf^^am 
areas; Natural' Science, Mathmatics, Social Studies, Career Education, 
and Communicatiori Skills (organized into 28 secondary level courses) . 
: Twenty-nine major concepts with 1^2 iSub-conccpts have been identified. 
From these stcm/'450 organizing objectives which have the capacity for 
yielding unlimited multitudes of instructional objectives. (Goldhammcr, 
et ai, p 7, 1974) . 



During thi init^fl Conceptualization Phas'e of tl^e AEL/EBCE^program three^ 
basic program characteristics were identified, first, the^EBCE program was 
to be an alternative, career oriented, educational experience for high school 
juniors and seniors. ' Second,' the students were to spend^^the majority of 
their time out of the classroom and in the commu-nity ^at cooperating exper- 
ience sites. Third, each student was to receiVe an indivi4ualized program _^ 
of lea'rning based on assessed academic/career 'interests and needs . .(Welsh , 
Ryan, pp. ^-10, 1-972). Implicit in these three statements was the need for . 
•the program to develop materials -and procedures for translating each stu- 
dent's EBCe" experiences in such a way'Ss to be acceptable for credit at the 
student's home hi|H school; also, ,there was a clear need for procedures to 
organize and analyze community sites so as to document the learning oppor- 
tunities that exist at each cooperating site-, finally, a mode of student 

■ learning had to be identified that would ensure the delivery ^f an individ- 
ualized set of program activities. Considering the implementation r^^quire- 
ments of such a program it was determined that there would have to be: (1) 
a .highly flexible curriculum structure for the academic component of the 
program; (2) a complete file of- document^ Vhich woulfi detail the learning 

■' opportunities at each cooperating experience -site;- (3) procedures tha* -woul4- 
rapidly identify and document each, student • s programmatic needs and inter- 
ests; and (4) an administratively simple program management system that 
would allow the instructional staff to monitor bach student's progress and 
performance in the program. The most critical part of the Conceptualization 
Phase was identifying the mode of student learning. It was obvipus that 

• teacher-centered or group-paced learning activities would be clearly inap- 

■ propriate given the mandate for iT.dividualized instruction. The utiliza^ 
tion of Programmed Texts and materials was ruied out because of the require- 
ment to integrate academic learning with, experiences out in 'the community. 



Considering all of the planned program charateristics* it was decided that^., 
an Independent Study Program based on an Inquir>7Quest approach to learning 
would be the most appropriate means- of personalizing e^h student's EBCE . 
program. A basic reference for the Inquiry /Quest approach taJcen i« the AEL/ 
EBCE program is- found" in the text, Education By Appointment , chapters 2 .and ' 
3. (Brown, 1968). The Inquiry/Quest approach was expanded and procedural- 
ized over the eighteen month period of program design and this approach now 
provides a systematic foundation for personalized, experiential ly-based 
learning, (see reference: Hyre, Inquiry: A Personalized Approach to Learn^ 
,ing , 1974). . ■ 

c 

Tfle 'final determination that was made in the Conceptualization Phase dealt 
with the role of the instructional staff. Given the goal of a personalized 
approach to learning, it was essential that a personal relationship be est- 
ablished between the teacher and each student. Th^ role that was finally 
selected would call for the instructional staff to act as "managers" and 
"coordinators" of student learning rather- than to serve as teachers who 
would disseminate specific facts and information for a given subject area. 
(Pfiffner, Nichols, 1973' and Shank, 1974). The instructional staff would, 
in effect,, act as "Educational Brokers" who would w6rk with .each student to. 
arrange and coprdinate learning experiences to satisfy the studenJJ si' estab- 
lished program goals. To operationally perform- ui^,-^' of "Learning 
. Coordinator" it was clear that specialized program documents would have to 
be designed for the instructional staff so as to facilitate. the rapid ident 
ification and accessing of a wide range of" learning activities , resources, 
.and career experienced. With this definil^on of the role of the instruc- 
tional staff, the overall conceptualization of the AEL/EBCE program was 
complete and the major operational (implementation) requirements had been 
identified. • ' 
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EBCE DESnSN FACTORS 
AND RELATIONSHIPS 



Te<rfinical Design Discussion: • 
Thi$ discussion Qutlines tne process wnerre'?;sci^Ts.Ai«pi*^nisMtii^«rt»i.M(.utrs i.-i iia^s.n^co 
by'the series of design matrices were est- 

' * ' it«isoNnutoAcrivirvs»«t(tt 

ablishpd for the AEL/EBCE program. -Figure 



3' displays- the conceptual relationships 
between the multiple factors that were add- 
ressed through the matri;x analysis .techni- 

MYSOMrOCCH I 

.ques for curriculum design, A fuH sized / ^ 



copy br Figure 3 is provided on the last 
page of this paper. The reader should re- 
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move that copy and refer to it as necessary 
' for clarification and for understanding of. the technical d^iscussions that 

follow. * ' 

■ « 

There were two primary concerns at the beginning of the Design Phase for the 
- AEL/EBCE program. First, was the need to establish a hierarchy of Concepfs 
and Objectives that would form a flexible curriculum base fe.r the EBCE pro- 
gram; and then to relate this. hierarchy 'to appropriate instructional resources 
that could be used by students, (see axes B, C, and D of Figure 3). Second, 
was the pressing need to organize-and ahalyze a series of community sites 
,tFat would provide a wide range of potential career and academic learn- 
ing experiences: and then to relate these sites to a system that would . « 
enable a student to select sites based on expressed, oa- measured interests, 
tsee axes &, F, and G of Figure 3). The initial priorities for the Design 
and Development efforts were that of establishing the Concepts and Object- 
ives Structure (axis C) and establishing a set of experience sitesy (axis E) . 

The-pro'cess of designing the hierarchy of Concepts and Objectives required 
itiputs from task forces of subject matter specialists (in the program areas 



-f^^atural Science'^ Mathmatics, Social Studies, Communication Skills, and 



• Career Educat^ion); anh a review of basic curriculum resource materials •(e.»g . , 

the Nationejl -Assessment of EducatiorfTal T>"|pgres^ series). After numerous 
.task force conferences and reviews a fiijal list of 291 majqr^ concept-s , 122 • 
^" ' sub-concepts, and 450 organising objectives we^e identified and the subject 
matter specialists reached a consensus that -the final st?ructure would form .. 
' •. an adequate curriculum base for the five program area^. This final listing 
bec'kme the entries for the Concepts and Objectives axi-s° (see axis C of Fig- 
ure 3). Once this axis was established, the task forces of specialists ^ 
identified the Iristructional Resources' (axis D). thaf'x:ould be utilized to ■ ' 
support student learning of tiie organi-zing objectives. The resulting matrix 
(i.e., the interrelationships between axes C and D o£ Figure 3) displayed in 
Araphic form a complete li-sting.of texts', film, strips-, audio cassettes,' 
' prb^grammed materials, etc., that were appropriat'e for the learning of each 
set of objectives. , o • ^ ^ 

^ ' ' ■ '. ■• ii 

. " The process for establishing the total set of coiranunity experience sites . 
' - ., , 

. faxis E of Figure 31 was somewhat more difficult than the process for design- 

1 ing the Concepts'and Objectivos axis, first,,. a strategy had to be establish- • 

. ed thafwouM secure the initial partdcipation an^ support of business , labor , . 

local government, and professional groups for the EBCE concept. The result- 

^ . ing design e.fforts produced a set 'of procedures and techniciues for contact- 

ing and presenting the EBCE program to the spectrum of cojimmity groups gnd 

' . for coordinating their particip^ion in the program. ' (Kaufman, 1974). .Next, 

a process had to be designed that would systematicaU-y define' and document 

the career and academic learning opportunities that were available at each . . 

~ ' cooperating experience site. Our initial site anaJysi& process^utilized the ' ^ 

"Funct.ipnal Task Analysis"* approach to job analysis. (Fine, 1971). . Tfejs ^ 

approach was expanded and refined, to produce a process for identifying and ' . 

documenting the Job Titles, Job functions; Job Responsibi-litics , and* the * ,^ . 

ERIC . . . ■ ' ? 9. 



range of special academic learning opportunities that were available at each 
-cooperating experience sitel (Pfiffner , 1974) . With the establishment of 
these procedures 120 different conununity sites were analyzed and the results 
of thi9 analysis formed the entries for axis E of .Figure 3. At this point, 
the next design problem was that of relating the opportunities which ex*- 
at the experience sites to the career interests of the individual stua -uo. 
The initial 'technique used by AEL to relate "student career interests to 
experi s wa?- based on the 15 Career Cijsters developed by the U.S. 

Office of Education. (USOE, 1972). The 15 Career Clusters, however, proved 
CO be much tod\^gross of an organizing system to provide any real job- selec- 
tion by students'.^ This technique was abandoned in favor of a more eff^jtive 



and prove-" techniqiite for relating individual interests to careers. AEL's'^ 
Career Decision-making Program had developed materials for relating an 
individual's career interests to the 114 Worker Ti Groups (found in the 
Dictionary ot/ Occup^tifSal Titles). Through a series of simple checklists, 
a modified version of the General Aptitude Battery (GATE), and the Ohio 
Vocational Interest Survey (OVIS) an individual could identify . which of the 
114 Worker Trait Groups ,^re most compatible with his or her interests, 
aptitudes, and abilities. The direct incorporation of^'this system formed the 
entries for axes F 'and G of Figure 3. By inspecting the* job titles found at 
each experience site^ and by using the AEL Manual, ''Guide for Exploring 
Careers Through Worker Trait Groups'* (Winefordner ," 1972>, each .job title 
could be cat(?gorized under, a specific Worker Trait Group. By adopting the. 
Worker Trait Group structu^f* the matrix network was establi^shed whereby a 
student's career interests could be assessed (axis G) and related to a speci- 
fic-Worker Trait Group (axis F) and then related to ^ specific sot of job. 
titles at cooperating experience sites (axis E of Figure 3). This network 
provided the needed information for placing the students at experience sites 
which are related to their career interests. 

Er|c s 10. 
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The last remaining design problem was that of translating EBCE learning 
experiences into a formal course credit structure. This was accomplished by 
re-establishing the task forces of subject matter -specialists and Community 
Advisory Council* members to identify specific course areas that could be 
legitimately covered by the previously established hierarchy of Concepts 
and Objectives. The efforts of these task forces produced a list of 28 
discrete courses of study that could be pursued^ within the EBCE program. 
This ^list of 28 courses Jbecame the entries for th^ Course Area axis (axis B 
of Figure 3). Formal procedures were then establi^shed -for' reviewing a 
student's high school record and transcripts (axis A) and fc^r selecting 
the appropriate EBCE courses that would provide the credits i^equired 
by the student for graduation. 

With the accomplishment of the step described in the' paragraph above, the 
tot^l matri^c network was in place to prov*ide complete information that re- 
lated: 

" ' D . ^ ' 

. • Student academic requirements -to- specific EBCE courses. 

• "Specific EBCE courses, -to- appropriate Concepts dnd Objectives, 
r Concepts arid Objectives -to- related Instructional Resources. 

« and 

' • Assessed Career Interests -to- related Worker Trait Groups. 

• Worker Trait Groups -to- specific jobs at experience sites. 

The results of the Conceptualisation Phase and the Design Phase produced 
the complete data base for the development of the procedures, manuals, and 
document? required by the Learning Coordinators to effectively deliver a 
personalised program of community based Inquiry/Quest learning activities t 
each student. The following is a descriptive list of the basic AEL/pBCE 
materials that were ultimately developed, produced, and implemented: 

• EBCE COURSE LIST: the document that lists and describes each 
course offered in the EBCE program. Used by the L.C. and the 
student. 



• COURSE KEYSORT CARDS: the keysort system used by the student • 
and the L.C, to select, by courses, the Concepts and Objectives 
that tl^e student will study while in the EBCE program 

• CONCEPTS AND OBJECTIVES MANUAL: the complete listing of the 
curriculiim structure, of the five major EBCE program areas. 

• PROGRAM DESCRIPTOR:' that portion of the student's program 
profile that lists tho- specific objectives which make up 
the 'student's EBCE program, 

• CROSS REFERENCE CATALOGS: the set of documents which relates^ 
-appropriate instructional resources, suggested student activities, 

and experience site opportunities" to each of the 450 organizing 
objectives. These catalogs are used by the L.C. and the student ^ 
to develop Activity Sheeto for each^course objectivfe selected by* 
by the student. 

• EXPERIENCE SITE LEARNING GUIDES: the document developed for each 
cooperating site. The guide provides a general description of 

the site and the types of jobs arid experiences that can be explored 
at the site. Used by the student and the L.C. for site selection. 

• ACTIVITY SHEETS: a single page .Learning Activity Package, written 
by the L.C. and the student, that explicitly describes the Inquiry/ 
Quest activities the student will follow to satisfy a specific 
learning objective (or set of objectives). 

• WORKER TRAIT GROUP KEYSORT CARDS: the keysort system used by the 
student to relate his or her career interests to specific Worker 
Trait Groups. This activity provides the information for placing 

I the student at a site that is related to the measured interests. 

/ • CAREER GUIDES ., 'the document used by the student while at an experi- 
/ ence site to gather information about the job and to use that 

/ information for career decision-making purposes. 

• BASIC PROCEDURES MANUAL: the . centralized listing of the step-by- 
step precedures for using the AEL/EBCE program materials. 

The materials listed above are the major curricular tools needed to operate 
.the AEL/EBCE program. An assortment of additional materials are also avail- 
able and are considered to be vital the the program in the aggregate. 



Summary : 

Throughout the preceding discussion of the matrix analysis process the estab- 
lishment of each axis was described as a separate and discrete design event. 
In actual practice, however, many of the axes were developed concurrently. 
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As the program design effort progressed to its final stages of refinement, 
it was determine.' that many of the initial design decisions were un-workable 
in "practice (e-g-V the use of the 15 USOE Career Clusters to relate student 
interests to specific careers). When this was the case, the specific axis 
was revised and refined so as to provide the necessary information to meet 
the operational reguirements of the emerging prograii). The critical point, 
however, was that the relationship of a given axis' to its connecting axis 
did not change nqr did the original conceptualization of the purpose of the 
axis. What this means to the curriculum designer is that the eritries on a 
given axis can be expanded, cont.-acted, or generally modified as long as the 
r-evised entries reflect an improved method of organizing and displaying the 
information on the axis; and as long as the revised entries establish a more 
valid relationship! to the connecting axis. This capacity for rapid and flex- 
ible revis^ion of specific axis" content' and information is the primary advan- 
tage of the Matrix Analysis approach to curriculum desi.gn. 
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APPENDIX A , 



System Development Flow^ 



/ 



\ Nichols, H.E., Schill, W.J., and McCartin, R. Individualiz ing Learning; 
A Resource Book. Seattle: The University of Washington, Department ot 
Higher Education, 1971. 
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NOT^: The fEBCE Design Factor^ and 
Relationships" diagram shown 0ri the 
next page;_is to b$ removed- anii used 
lLs"Vreference while reading/ the 
Technical Discussion Sectioi)' of this 
paper (pages 8 through 11)./ 
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